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(54) An apparatus for extracting skin pattern features and a sUn pattern image processor 



(57) A skin pattern image is filtered by convolution 
calculation on a real plane or product calculation on a 
Fourier transformed plane with each of two-<£mensional 
filters prepared according to kinds of features to be 
extracted of the skin pattern image. Image intensity of 
each subregion of each filtered data is calculated. Fea- 
ture of each subregion is represented by a feature 
parameter corresponding to a fitter that gives a highest 

FIG. 1 



value of the image intensity of the subregion. An initial 
pattern of features thus obtained is smoothed to mini- 
mize an evaluation function. A filtered skin pattern 
image having pixel values of each subregion smoothed 
by a set of filters prepared for extracting a kind of fea- 
tures is further filtered by another set of filters for 
extracting another kind of features. 
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EP0 737 932 A2 

Description 

This invention relates to an apparatus for extracting features of skin pattern images and an image processor for 
smoothing and enhancing features of the skin pattern images making use of the extracted features. More particularly, 
5 the invention relates to an apparatus for extracting such features as ridge line directions, ridge line pitches or their com- 
bination of skin pattern images for fingerprint verification, fingerprint classification or palm print verification, and an 
image processor for processing skin pattern images for enhancing ridge lines by eliminating noises of the images mak- 
ing use of the extracted features. 

As a prior art. there is a Japanese patent application entitled "An Apparatus for Striped Pattern Extraction" and laid 
10 open as a Provisional Publication No. 771 38/'76. In the prior art, which is hereafter called a first prior art, an apparatus 
is disclosed for eliminating noises from such striped images as fingerprints or tree rings and extracting both stripe pat- 
terns and directional patterns of the striped iniages. 

FIG. 1 4 shows principle of the apparatus. An image in a subregion 1 00 with its center at a small square 101 is rep- 
resented by a set of pixel data. Each small square in the subregion 100 represents a pixel, and a numeral 1 or a blank 
15 in a small square means corresponding pixel value 1 (black) or 0 (white). Filter data sets 102, 103, 104, 105, and 106 
for masking are prepared corresponding to no direction dO and four directions cf1, d2, dS, and d4 respectively. By cal- 
culating their sum of products with the pixel data of the image exampled in FIQ. 14, values -h5, 0. +11 . +3 and -7 are 
obtained corresponding to each direction dO to d4 respectively. 

From these values, ridge direction at pixel 1 01 of the image is determined to the direction d2 which gives the max- 
20 imum value +1 1 and stripe pattern value at the pixel 101 is determined to the maximum value +11. 

Thus, stripe patterns and directional patterns are extracted as features of striped images in the first prior art. 
Smoothing of extracted features is sometimes necessary for decreasing noise influence on the features. For the 
purpose, a smoothing method is disclosed in a Japanese patent application entitled "Method of Smoothing a Ridge 
Direction Pattern and an Equipment used therefor" and laid open as a Provisional Publication No. 18195/93. This 
25 smoothing method, hereafter called a second prior art, is based on a minimum energy principle. 

From ridge direction data extracted with their reliability coefficients, a smoothed ridge direction pattern is deter- 
mined in the prior art. wherein it is assumed that direction data extracted with the higher reliability need the more energy 
to be smoothed into a direction pattern and that it needs the more energy to smooth direction data into a direction pat- 
tern the more different from neighboring direction patterns. Therefore, a direction pattern which gives a minimum value 
30 of an evaluation function, linear summation of those energies, is determined as the smootiied direction pattern of a sub- 
region. 

However, pixel values of a striped image vary periodicaly in a direction perpendicular to the stripes. Therefore, 
when stripe phase of a striped image is nearly orthogonal to the stripe phase of the filter data for masking used in the 
first prior art. tiie sum of products results nearly 0 even when botti directions coincide with each other. This means tiiat 
35 the extracted direction patterns and. consequentiy, the extracted stripe patterns become unreliable influenced by noise 
data, making precise rklge line pitch extracion difficult 

In tiie second prior art. smoothing of ridge direction patterns is performed based on extracted ridge directions. So. 
when extracted ridge direction data are not reliable, precise smoothing of ridge direction patterns and. consequentiy. 
precise smoothing of ridge line pitches can not be performed. 
40 Therefore, a primary object of tiie invention Is to provide an apparatus for extracting features such as ridge direc- 
tions, ridge line pitches or tiieir combination from skin pattern images witii high reliability regardless of the sti-ipe phase 
difference, and another object is to provide a skin pattern image processor for precisely enhancing ridge line pattems 
by eliminating noises from the skin pattern images. 

In order to achieve tiie objects, a plurality of filters consisting of two-dimensional weight coefficient matrix are pre- 
45 pared in the present invention according to kinds of features to be extracted. 

A skin pattern image is filtered with each by each of tiie plurality of filters by convolution calculation on a real plane 
or by product calculation of each frequency component on a Fourier transformed plane. 

Contrast or image intensity, that is, a square sum of pixel values of a subregion of each filtered image thus calcu- 
lated is compared with each other and a feature parameter represented by a filter which gives a largest image intensity 
50 is determined as the feature to be exti'acted of tiie subregion of the skin pattern image. 

And from pixel values of the image data of subregions filtered by a filter giving the feature of the subregion. image 
data of the subregion with enhanced feature can be obtained at the same time. 

The foregoing, further objects, features, and advantages of this invention will become apparent from a considera- 
tion of tiie following description, tiie appended daims. and the accompanying drawings in which the same numerals 
55 indicate the same or the corresponding parts. 

FIG. 1 is a block diagram illustrating a first embodiment of the invention. 

FIG. 2 illustrates an example of a filter designed on a Fourier transformed plane. 

FIG. 3 shows frequency bands of five filters prepared for extracting ridge line pitches. 

FIG. 4 shows shading images of tiie five filters of FIG. 3. 
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FIG. 5 illustrates an example of arrangement of subregions in a skin pattern image. 

FIG. 6 is a block diagram of a filtering means 24 of a second embodiment of ttie invention. 

FIG. 7 is a block diagram of a feature extracting means 30 of a third embodiment of the invention. 

FIG. 8 illustrates a subregion C{m,n) and neighboring subregions C(/n',n') around the subregion C(m.n). 
5 FIG. 9 is a flowchart illustrating operation of the feature extracting means 30 of FIG. 7. 

FIG. 10 is a block diagram illustrating a fourth embodiment of the invention. 

FIG. 11 is a block diagram illustrating a fifth embodiment of the invention. 

FIG. 12 shows shading images of examples of filters prepared in a first filter file 81 1 of FIG. 1 1 . 

FIG. 13 shows shading images of examples of filters prepared in a second filter file 812 of FIG. 1 1 . 
10 FIG. 14 is a diagram illustrating principle of a prior art. 

Nkiw, embodiments of the present invention will be described in connection with the drawings. 

Referring to FIG. 1, a first embodiment of the invention comprises a image memory 11 for storing image data of 
such skin patterns as fingerprint pattern images, a filter file 1 5 for storing filters prepared for filtering the image data read 
out from the image memory 1 1 , filtering means 12 for filtering the image data by convolution calculation each by each 
15 with filters stored in the filter file 1 5, image intensity calculation means 1 3 for calculating image intensities of subregions 
of each of the filtered data, and feature extracting means 14 for determining features of predetermined subregions of 
the image data, in accordance with the results calculated in the image intensity calculation means 13. 

The image memory 1 1 is composed of a hard disk memory or a DRAM for storing digital image data of skin pattern 
images as fingerprint pattern images or palm print pattern images collected by an input device as a CCD camera or an 
20 image scanner. 

In the filter file 1 5, a plurality of filters used by the filtering means 1 2 are prepared according to a kind of features to 
be extracted in a DRAM for example. 

In the following descriptions, a set of image data stored in the image menfx>ry 1 1 is assumed to be data of 512 x 
512 pixels with resolution of 20 pixels per mm, and is expressed by a function g{x,y) representing pixel values at coor- 
ds dinates (x,y), where x=0. 1 , 2 51 1 and y=0, 1. 2 51 1 . 

Now, the convolution calculation, and its correspondence to Fourier transform performed in the filtering means 12 
Is described, taking the case for extracting features of ridge line pitches as an example. 

When image data are expressed by g(x,y) (x=0, 1 m-1 and y=0. 1 n•^) and a filter is expressed by h{x,y) 

(x=0, 1 m/,-1 and y=0, 1 , 2, .... /7/,-1), the convolution z(x,y) of the image data g{x,y) and a filter h(x,y) is calculated 

30 as following equation (1 ). 

/=0 >=0 

35 

This convolution calculation on a real plane is equivalent with a product calculation represented by following equa- 
tion (2) of each frequency component on a Fourier transformed plane. 

40 F{g{x.yrh{x.y)] = F{g(x.y)] • F{h{x.y)] ' (2) 

= G{u.v)*H{u,v) 

where, A*B means convolution of A and S, F{A] means two-dimensional Fourier transform of A, and G(u,v) and 
45 H{u,v) mean the Fourier transforms of g(x,y) and h(x,y) expressed on the Fourier transformed plane respectively 
The two-dimensional Fourier transform is calculated as following equation (3). 



so 




where u=0, 1 m-^ and v=0, 1 n-1. 

And by following equation (4), inverse Fourier transform, a Fourier transform is transfen^ed on the real plane. 

55 

^ m-1n-1 
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Here, for shifting the direct current component G(0,0) to a center of the Fourier transformed plane. Fourier trans- 
form of (-1)^*^^(x,y), hereafter called an optical Fourier transform, is often used for convenience of calculation. 

Returning to FIG. 1. preparation of filters for extracting features of ridge line pitches in the filter file 15 will be 
described. 

5 For preparing a filter which fitters out images of pitch frequency under and over an ideal band-pass filter 
H{u,v) represented by following equation (5) and illustrated in FIG. 2 is designed on an optical Fourier transformed 
plane. 

fa whenHi<(ii2 + v2)i/2<i?2 
H{u, v)=\ 

I 0 otherwise. 



(5) 



^5 

Here, a is a constant for normalizing outputs of different filters, determined as follows, for example. 

a=1/(R|-R?) (6) 

20 When the resolution of an image is 20 pixels per mm, the ridge line pitches are in a range from about 5 pixels to 20 
pixels. This range from about 5 pixels to 20 pixels corresponds to a frequency range from about 1 00 cycles to 25 cycles, 
difining 512 pixels as a cycle. 

This frequency range from 25 cycles to 100 cycles (a frequency band of 75 cycles) is divided into five ranges of 
frequency band of 15 cycles each, for example, for designing five filters conresponding to each thereof as shown by lr\ 

25 to ^5 in FIG. 3. 

Then, from these filters H/(t/,v)(/=1, 2 5) designed on the optical Fourier transformed plane, inverse Fourier 

transforms are calculated for obtaining filters /7/(x.y)(/=1, 2 5) to be applied for convolution calculation on the real 

plane. In this inverse Fourier transform, higher frequency components are ignored for simplifying the convolution calcu- 
lation. Thus, filters on the real plane are obtained approximating con-esponding ideal band-pass filters h-^ to of FIG. 
30 3. In the example, filter size of these transformed filters is 64 x 64 pixels. FIG. 4 shows shading images of these five 
filters defined by /i^ to /i^ of FIG. 3. The data of these filters shown in FIG. 4 are stored in the filter file 15. 

In the filtering means 12, a convolution calculation expressed by the equation (1) is performed. When each of the 

five filters is denoted by /7/(x,y)(/=1. 2 5). filtered data obtained through filtering by a filter /i/(x.y) are expressed by 

p,(x.y) as follows. 

35 

9i(x,yh9(x.yrhf{x,y). (7) 



Five sets of filtered data ^/(x,y)(/=1 , 2, 5) are delivered to the image intensity calculation means 13. 
In the image intensity calculation means 13, image intensities P{i\m,n) of predetermined subregions C{m,n) of 
40 each set of the filtered data d/(^,y) are calculated as following equation (8). 



45 



55 



F(/,/n.n)= 5^ g,(x.y)2 (8) 
(x,/)eC(m.n) 



Here, in the embodiment, each of the subregions C(m.n) is defined as a square region consisting of 32 x 32 pixels 
as shown in FIG. 5, having its center on coordinates (m.n) arranged by every 16 pixels in x and y direction of the plane 
of 51 2 X 51 2 pixels, as represented by a bullet in FIG. 5, of each set of filtered data 
50 The image intensity calculation means 13 delivers the calculated results P{i,m,n) to the feature extracting means 
14. The feature extracting means 14 determine features of the predetermined subregions of the skin pattern Image. 
When a filter h^[x,y), for example, represented by /7i in FIG. 3 gives the maximum value of the image intensities 
P(/,n7.n)(/=1 , 2 .... 5) for a subregion C(An.n), ridge line pitch Qfeature t of the subregion C{m,n) is calculated as fol- 
lows. 



X= 512 ^gj 
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(25 + 40)/2 



5 Thus, features for every subregion are determined in the feature extracting means 1 4. 

Now, a second embodiment of the invention is described, wherein filtering off skin pattern images are performed by 
product calculation of each frequency component of the Fourier transforms. 

FIG. 6 is a block diagram of another filtering means 24 of the second embodiment corresponding to the filtering 
means 12 of FIG. 1, comprising Fourier transformation means 21 for performing two-dimensional optical Fourier trans- 
10 form of image data read out from the image memory 1 1 , masking means 22 for performing product calculation between 
image data deliverd from the Fourier transformation means 21 and filters prepared in a filter file 25, and inverse Fourier 
transformation means 23 for performing inverse optical Fourier transform of the masked data obtained from the mask- 
ing means 22. 

The embodiment is described following the example applied in connection with the first embodiment for extracting 
15 features of ridge line pitches of a skin pattern image. 

In the filter file 25, the ideal band-pass filters Hi{u, v){h^ , 2. ...5) designed on the optical Fourier transformed plane 
having data of 512 x 512 pixels are stored intact without transformation. TTie Fourier transformation means 21 trans- 
forms the skin pattern image g(x,y) according to the equation (3) for obtaining an optical Fourier transform G{u,v) 
thereof. 

20 In the masking means 22, real and imaginary part of each frequency component of the Fourier transform G{u,v) 
are multiplied by those of the five band-pass filters v^) one by one. 

Five sets of masked data Gf{u,v)=^G{u.v)* Hf(u,v) are processed with inverse optical Fourier transform 
described in connection with the equation (4) in the inverse Fourier transformation means 23 for obtaining five sets of 
filtered data 5i/(x,y) to be processed in the image intensity calculation means 1 3 of FIG. 1 as same as in the first embod- 

25 iment. 

Filtering by convolution calculation as performed in the first embodiment needs a number of operations proportional 
to the filter size. So, the filters for convolution calculation are generally restrained in a size. 64 x 64 in the example 
described, accompanied with Inevitable approximation. 

On the other hand, for f ilering by masking calculation as performed in the second embodiment, ideal band-pass f il- 
30 ters can be desigend in a finite Fourier transformed plane with no approximation. Further more, for image data with its 
sides expressed by a power of 2, fast Fourier transform can be applied for high speed calculation. 

It is apparent that the optical Fourier transform can be replaced with the fast Fourier transform or an ordinary digital 
Fourier transform by preparing appropriate filters. Therefore, it can be said that there are more merits in the second 
embodiment compared to the first embodiment when filter size is not sufficiently small. 
35 Now. a third embodiment will be described, wherein the feature extracting means 14 of FIG. 1 is replaced with 
another feature extracting means 30 illustrated in FIG. 7. 

In the third embodiment, there is defined an evaluation function, variable of which are feature parameters of each 
subregion, representing sum total of image intensities (multiplied by -1) of all subregion and sum total of square sums 
of differences between values of the feature parameter of each subregion and that of neighbouring subregions. Each 
40 of the feature parameters which gives the minimum value of the evaluation function is determined as the feature of each 
subregion in the third embodiment. 

For the purpose, the feature extracting means 30 of FIG. 7 comprises minimizing means 31 and initial value catcu- 
latfon means 32. 

From the image intensity calculation means 13 of FIG. 1 . the image intensities P{i.m,n) are delivered to the initial 
45 value calculation means 31 for determining initial \^lues So(m,n) of feature parameters, namely ridge line pitches that 
give a highest value of the image intensities P{i,m,n) of each subregion C(m.n) as same as in the first embodiment. 

The map of the initial values So(m,n) for all the subregions shows an initial two-dimensional feature pattern off the 
skin pattern image. For smoothing the initial two-dimensional feature pattern, the initial value So{m,n) of a concerning 
subregfon C(m,n) is replaced with a most appropriate value s(m,/7), among five values of feature parameters, which 
so gives a minimum value off the evaluation function E{s{m,n)) represented by a following equation (10) in the minimizing 
means 31. 

E(s(m,n))=- P(s(m./?).(/n./7)+ ^ Ci(s(m.n).So(n7',n')) (10) 

55 (m.n) {m,n){m',n*) 
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where. (m\n) means coordinates of neighbouring subregions of the concerning subregion C{m,n), 5x5-1 subregions 
shown in FIG. 8 in an example, and D{s{m,n), Soim^nJ) is a function representing singularity of a value s(m,n), namely 
the current feature parameter, among its neighbourhood, expressed as follows in an example, a being a coefficient. 

5 D{s{m,n),SQ(m',n))=a{s{m,nysQ{m\n')f (11) 

Thus, the minimization of the evaluation function E{s(m,n)) Is performed for every subregion C{m,n) replacing ini- 
tial value So(n?,n) by an appropriate value s(m,n) one by one, and these processes are repeated several times deter- 
mined for converging the minimization as shown by a flowchart illustrated in FIG. 9. 
10 In step 41 . initial value of the evaluation function E is calculated according to the equation (1 0) with the initial values 
So(m,/7) of feature parameters. Then, in step 42, value of the evaluation function E is recalculated for a subregion 
C(m,n) with other values s^(m.n) one by one (checked in step 45) for replacing the Initial value SQ{m,n) (in step 44) 
when the evaluation function E is found reduced (in step 43). Steps 42 to 46 are performed for all subregions C(m,n) 
through step 46 and repeated several times through step 47. 
IS Thus a smoothed two<limensional feature pattern giving the minimum value of the evaluation function E is 
obtained in the embodiment. 

Now referring to FIG. 10, a fourth embodiment providing a skin pattern image processor is described, wherein the 
extracting method of skin pattern features of the invention is applied. 

In the block diagram of FIG. 10, pixel value calculation means 75 are comprised in addition to the block diagram 
20 referred to in connection with the first, second or tiie third embodiment, for generating inriage data of a feature enhanced 
skin pattern. 

Taking the example of FIG. 5. each pixel belongs to four subregions since the subregions are defined overlapped. 
Therefore, at most four values are obtained for each pixel from filtered data sets corresponding to features assigend to 
the four subregions where the pixel belongs. Average of these at most four values for each pixel is output as each pixel 
25 value of the image data of the feature enhanced skin pattern image. 

In a fifth embodiment illustrated in FIG. 1 1 . skin pattern image processors of FIG. 10 are cascaded for enhancing 
plural kinds of features of skin pattern image data. An example of the embodiment of FIG. 1 1 consists of two skin pat- 
tern image processors 80 and 81. wherein skin pattern image data enhanced of ridge line pitch features by the skin pat- 
tern processor 80 are stored in a second image menrK>ry 806 to be processed with filters prepared for extracting ridge 
30 line direction features of tiie skin pattern image data. 

Therefore, a more snxx)thed skin pattern image can be obtained witii features of two kinds enhanced in the embod- 
iment. 

It goes without saying that feature data of each kind, to be used for classifying skin pattern images for example, can 
be obtained also in the embodiment from each feature extracting means 804 and 809 in addition to tiie feature 
35 enhanced skin pattern. 

The embodiments are described heretofore in connection witii tiie example provided of five filters for extracting 
ridge line pitch features. However, any other appropriate filters can be used for extracting desired features of skin pat- 
tern images and processing them for enhancing the desired features thereof. 

In the following paragraphs, other examples of filter sets prepared for masking Fourier transforms of skin pattern 
40 image data are described. 

FIG. 12 shows shading images of a filter set consisting of ten band-pass filters for extracting ridge line pitch fea- 
tures by masking optical Fourier transfornns of skin pattern image data prepared in a first filter file of 81 1 of tiie embod- 
iment of FIG. 1 1 . Pixel values Wr(\r\) of each of the band-pass filters of FIG. 12 are represented by following equation 
(12) symmetric witii respect to Its origin. 

^'(W) = A- (-^)//r- (-^) ''Hf^^) 

50 

where vector r denotes coordinates of a pixel on an optical Fourier transformed plane of 512 x 512 pixels with origin at 
its center, /q and con-esponding to a center frequency and a frequency width of pass-band respectively of each of the 
ten band-pass filters. 

In the examples of FIG. 12. tq are an'anged by every 5.7 pixels from 28.4 to 79.6 pixels on condition is 12.0. 
55 By the way, shading images in FIG. 1 2 show center regions of the band-pass filters and the brighter dot represents 
the larger pixel value, darkest dot representing pixel value of 0. 

FIG. 13 shows shading images of another filter set consisting of 16 directional filters for extracting ridge line direc- 
tion features by masking Fourier transforms of skin pattern image data prepared in a second filter file 812 of tiie exam- 
ple of FIG. 1 1 . Pixel values IVe(r) of each of the directional filters of FIG. 1 3 are represented by following equation (1 3) 
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line symmetric. 



W,(r) = exp (-^(cos-'t^) j (13) 



where, ee = (cose, sine) denotes unit vector of each direction 6 represented by each of the directional filters and ae. 0.4 
in the examples of FIG. 13. is a parameter representing phase angle width of the pass-band. 
10 As for the singulality function D{s{m,n), So{m\n')) in the evaluation function E of the equation (10), Euclideari dis- 
tances expressed by following equation (14) are better to be applied here, for smoothing directional features by direc- 
tional filtering, instead of the equation (11). 

D(s(m,n),SQ{m',n')) = a{(sin2e(m.n)-sin20(m',/7'))^ (14) 

IS 

+(cos2e(/n.n)-cos2e(m',A7')) ^} 



where 8(fn.n) Is directional feature of a subregion C(m,n). 

Thus, by smoothing ridge direction features of a skin pattern image after smooting its ridge line pitch features, or 

20 vice versa, a more enhancing and reliable image processing can be provided in the present invention. 

Returning to FIG. 1 1 , two skin pattern Image processors of FIG. 1 0 are cascaded in the fifth embodiment for obtain- 
ing smoothed skin pattern images with their features of two kinds enhanced or extracting two kinds of features. How- 
ever, by preparing filters according to kinds of features to be extracted or enhanced, plural kinds of features can be 
extracted or enhanced of a skin pattern image with one skin pattern image processor. 

25 In a sixth embodiment having the same configulation with the fourth embodiment of FIG. 10, a filter set for extract- 
ing and enhancing plural kinds of features, ridge line pitch features and ridge line direction features for example, is pre- 
pared in the filter file 25. 

For preparing the filter set corresponding to the filter sets of FIG. 12andFIG. 13, each filter Is given from a product 
^e.XO of a filter of FIG. 12 expressed by the equation (12) and a filter of FIG. 13 expressed by the equation (13) as 
30 follows. 



W,,,(r) = W,{r)Wr(\r\) 

- c-cpf Vc..-'l'-^l)'1 (15) 



40 

If the ridge line pitch features are to be ciassifyed into ten values of Tq and the ridge line direction feachures are to 
be ciassifyed into 16 values of 0 as same as FIGs. 12 and 13, a set of 160 filters is thus prepared. 

In the image intensity calculation means 13 of the sixth embodiment, image intensities P(0.ro,An.n) of the predeter- 
mined subreglons C{m,n) are calculated for every 160 filtered data g(OJo,x,y) obtained from the skin pattern image 
45 g(x,y) by filtering with the 160 filters WQ f(r) as follows in a same way as the equation (8). 



P(e.ro./n,/7)= 2^ ^{e.ro.x.y)' 



50 



In the feature extracting means 30 of the sixth ernbodiment. vector values 



representing ridge line pitch featuers and ridge line direction features for the predetermined subregions C(m,n) are 
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obtained from the image intensities P(6.ro,m,n) calculated by the inrtage intencity calculation means 13 in a similar way 
as described in connection with FIGs. 7 to 9. 

In the initial value calculation means 32. initial values Vo(m,n) are calculated from parameters (0, Tq) of filters lA^e.XO 
which give maximum intencities P{0,ro,m,n) of filtered data for the predetermined subregions C{m,n). Starting from the 
initial values Vo{m,n), a two-dimensional feature pattern of the vector values v(m,n) is determined in the minimizing 
means 31 to minimize an evaluation function represented by a following equation (16). 

E{v{7n,n)) = - E P{0,ro,m,n) 

(ni,n) 

+ E E Divim,n),vo{m',n')) (16) 

(m,n) (m'.nO 

where, 

D{v{m^ n), VQ{m\ n')) = a{(sm 2d(m, n) — sin 2tf (m', n'))^ 

+(cos 2e(m, n) - cos 2^(m', n'))^} 
+/?{ro(m,n) - r5(m',n')p 



Thus, two kinds of features of each subregion of a skin pattern image are extracted in the sixth embodiment. The 
smoothed skin pattern image is obtained by the pixel value calculation means 75 In the same way with the fourth 
enfibodiment from filtered data corresponding to the two kinds of features extracted for each subregion. 

And as beforehand described, still more kinds of features can be extracted and still more kinds of filtering or 
smoothing can be performed with still more kinds of filter sets in the scope of the invention. 

Claims 

1 . An apparatus for extracting features of predetermined subregions of a skin pattern infiage, comprising: 

an image memory (1 1) for storing image data of the skin pattern image; 

a filter file (1 5) for storing a plurality of filters consisting of two-dimensional data prepared according to the fea- 
tures to be extracted; 

filtering means (12) for outputting filtered data sets, each of said filtered data sets obtained from said image 
data by convolution calculation with each of said plurality of filters; 

image intensity calculation means (13) for calculating image intensity of each of the predetermined subregions 
of each of said filtered data sets; and 

feature extracting means (14) for determining tiie features of the predetermined subregions of tiie skin pattern 
Image refen-ing to said image intensity of each of the predetermined subregions of each of said filtered data 
sets. 

2. An apparatus for extracting features of predetermined subregions of a skin pattern image, comprising: 

an image memory (1 1) for storing image data of the skin pattern image; 

a filter file (1 5) for storing a plurality of filters consisting of two-dimensional data prepared according to the fea- 
tures to be extracted; 

filtering means (24) for outputting filtered data sets, each of said filtered data sets being an inverse Fourier 
transform of a masked data set obtained from a Fourier transform of said image data by product calculation of 
each frequency component of said Fourier transform and each of said plurality of filters; 
image intensity calculation means (13) for calculating image intensity of each of the predetermined subregions 
of each of said filtered data sets; and 

feature extracting means (14) for determining the features of tiie predetemiined subregions of tiie skin pattern 
image refemng to said infiage intensity of each of tiie predetermined subregions of each of said filtered data 
sets. 
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An apparatus for extracting features of predetermined subregions of a skin pattern image, recited in one of claim 1 
and claim 2; wherein: 

said feature extracting means (14) determine the features of the predetermined subregions of the skin pattern 
image according to feature parameters of each of said plurality of filters which gives a maximum value of said 
image intensity of each of the predetermined subregions among said plurality of filters. 

An apparatus for extracting features of predetermined subregions of a skin jpatt&n image, recited in one of claim 1 
and claim 2; wherein: 

said feature extracting means (14) determine the features of the predetermined subregions of the skin pattern 
image accoiding to feature parameters minimizing an evaluation function, said evaluation function being a lin- 
ear function of said image intensity of each of the subregions of one of said filtered data sets corresponding to 
a feature parameter assigined to said each of the subregions. and a value corresponding to singularity of said 
feature parameter assigned to said each of the predetermined subregions compared to the feature parameters 
assigned to certain of the predetermined subregions neighbouring to said each of the predetermined subre- 
gions. 

A skin pattern Image processor for generating a filtered skin pattern image by smoothing and enhancing features 
of predetermined subregions of a skin pattern image, comprising: 

an image memory (1 1) for storing Image data of the skin pattern image; 

a filter file (15) for storing a plurality of filters consisting of two-dimenstonal data prepared according to the fea- 
tures to be extracted; 

filtering means (12) for outputting filtered data sets, each of said filtered data sets obtained from said image 
data by convolution calculation with each of said plurality of filters; 

image Intensity calculation means (13) for calculating image intensity of each of the predetermined subregions 
of each of said filtered data sets; and 

feature extracting means (14) for determining the features of the predetermined subregfons of the sWn pattern 
image refen^ing to said image intensity of each of the predetermined subregions of each of said filtered data 
sets; and 

pixel value calculating means (75) for calculating a value of each pixel of the filtered skin pattern image from 
values of pixels of certain of said filtered data sets corresponding to said each pixel, each of said certain of said 
filtered data sets corresponding to each of the features extracted of the predetermind subregions where said 
each pixel belongs. 

A skin pattern image processor for generating a filtered sWn pattern image by snfx>othing and enhancing features 
of predetermined subregions of a skin pattern image, comprising: 

an image memory (1 1) for storing image data of the skin pattern image; 

a filter file (15) for storing a plurality of filters consisting of two-dimensional data prepared according to the fea- 
tures to be extracted; 

filtering means (24) for outputting filtered data sets, each of said filtered data sets being an inverse Fourier 
transform of a masked data set obtained from a Fourier transform of said image data by product calculation of 
each frequency component of said Fourier transform and each of said plurality of filters; 
image intensity calculation means (13) for calculating image intensity of each of the predetermined subregions 
of each of said filtered data sets; and 

feature extracting means (1 4) for determining the features of the predetermined subregions of the skin pattern 
image referring to said image intensity of each of the predetermined subregions of each of said filtered data 
sets; and 

pixel value calculating means (75) for calculating a value of each pixel of the filtered skin pattern image from 
values of pixels of certain of said filtered data sets corresponding to said each pixel, each of said certain of said 
filtered data sets corresponding to each of the features extracted of the predetermind subregions where said 
each pixel belongs. 



A skin pattern processor recited in one of claim 5 and claim 6, wherein: 
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said feature extracting means (14) determine the features of the predetermined subregions of the skin pattern 
image according to feature parameters of each of said plurality of filters which gives a maximum value of said 
image intensity of each of the predetermined subregions among said plurality of filters. 



5 8. A skin pattern processor recited in one of claim 5 and claim 6, wherein: 



said feature extracting means (14) determine the features of the predetermined subregions of the skin pattern 
image according to feature parameters minimizing an evaluation function, said evaluation function being a lin- 
ear function of said image intensity of each of the subregions of one of said filtered data sets corresponding to 
10 a feature parameter assigined to said each of the subregions, and a value con-esponding to singularity of said 

feature parameter assigned to said each of the predetermined subregions compared to the feature parameters 
assigned to certain of the predetermined subregions neighbouring to said each of the predetermined subre- 
gions. 

15 9. A skin pattern processor recited in one of daim 5 and claim 6, wherein said image data of the skin pattern image 
are image data of a filtered skin pattern image processed by another skin pattern processor by smoothing and 
enhancing the features of another kind of a skin pattern image. 



20 



25 



30 



35 



40 



45 



50 



55 



10 



EP 0737 932 A2 



FIG. 1 



SKIN PATTERN IMAGE 
11 



IMAGE MEMORY 



I 



12 



FILTERING MEANS 

1 



13 



IMAGE INTENSUTY 
CALCULATION MEANS 



T 



14 



FEATURE 
EXTRACTING MEANS 



15 



FILTER FILE 



EXTRACTED FEATURES 



FIG. 2 




U 



11 



EP0737 932 A2 

FIG. 3 





Ri (cycle) 


R2Ccvcle) 


h 


25 


40 


hi 


40 


55 


h3 


55 


70 


h4 


70 


85 


hs 


85 


100 



FIG. 4 




(a) {RuR2) = (25,40) (b) (fli.iJj) = (40,55) (c) (ili.iia) = (55,70) 




(d) {Ri , iij) = (70, 85) (e) (i?, , iij) = (85, 100) 



12 



EP0737 932 A2 




FIG. 6 



24: FILTERING MEANS 

IMAGE DATA 



.fr:: 



FOURIER 
TRANSFORMATION 
MEANS 



21 



22 



MASKING MEANS 



23 



INVERSE FOURIER 
TRANSFORMATION 
MEANS 



25 



FILTER FILE 



FILTERED DATA SETS 



13 



EP0737932 A2 



FIG. 7 



30: FEATURE EXTRACTING MEANS 
IMAGE INTENSITIES 



MINIMIZING MEANS 



1 



32 



INITIAL VALUE 
CALCULATION MEANS 



EXTRACTED FEATURES 



FIG. 8 



(m-2,n-2) 


(iTr-l,n-2) 


(m,n-2) 


(m+1,n-2) 


(m+2,n-2) 


(m-2.n-1) 


(m-1,n-1) 


(m,n-1) 


(m+1,n-1) 


(m+2.n-1) 


(m-2,n) 


(m-1,n) 


(m,n) 


(m+1,n) 


(m+2,n) 


(m-2,n+1) 


(m-1,n+1) 


(m.n+1) 


Cm+1,n+l) 


(m+2,n+1) 


(m-2.n+2) 


Cm-1 ,n+2) 


(m,n+2) 


[m+1,n+2) 


Cm+2.n+2) 



14 



EP0 737932 A2 



6 



FIG. 9 



c 
E 
O 

h- 

X 

ill 
z 

o 



( start) 



41 



CALCULATE 
EVALUATION FUNCTION^ 



42 



RECALCULATE 
EVALUATION FUNCTIONE 
WITH 8(m.n) AT C(m,n) 



NO 




REVISE 8(m,n) 




15 



EP0737 932 A2 



FIG. 10 



SKIN PATTERN IMAGE 
11 



IMAGE MEMORY 



I 



12/24 



15/25 



FILTERING MEANS 



FILTER FILE 



13 



IMAGE INTENSUTY 
CALCULATION MEANS 



I 



14/30 



FEATURE 
EXTRACTING MEANS 



75 



PIXEL VALUE 
CALCULATION MEANS 



ENHANCED IMAGE 



16 



EP0737932A2 



FIG. 11 



FIRST IMAGE MEMORY 



SKIN PATTERN IMAGE 

.801 



,802 



80 



811 



FIRST FILTERING MEANS 



I 



FIRST FILTER FILE 



IRST IMAGE INTENSUTY 
CALCULATION MEANS 

I 



803 



804 



FIRST FEATURE 
EXTRACTING MEANS 

~~1 



805 



FIRST PIXEL VALUE 
CALCULATION MEANS 



ISECOND IMAGE MEMORyH ^ 



806 
807 



812 



SECOND FILTERING MEANS} | * 1 jSECOND FILTER FILE 1 

808 



SECOND IMAGE INTENSUTY 
CALCULATION MEANS 



809 



SECOND FEATURE 
EXTRACTING MEANS 



810 



SECOND PIXEL VALUE 
CALCULATION MEANS 



ENHANCED IMAGE 



81 



17 



EP0737 932 A2 



FIG. 12 




(a)ro = 28.4 (b) ro = 34.1 (c) ro = 39.8 (d) ro = 45.5 




(e) To = 51.2 (f)ro=:56.9 (g) ro « 62.3 (h)ro = 68.3 




(e) ro = 74.0 (f) ro = 79.6 



18 



EP0 737 932 A2 



FIG. 13 




19 



EP0737932 A2 



FIG. 14 PRIOR ART 



102 



dO 





-1 


-2 


-1 




-1 


1 


2 


1 


-1 


-2 


2 


4 


2 


-2 


-1 


1 


2 


1 


-1 




-1 


-2 


-1 





100 









1 


1 






1 


1 


1 




1 










1 


1 






1 


1 









101 



103 



d1 



-1 


-2 


-2 


-2 


-1 




1 


1 


1 




1 


2 


4 


2 


1 




1 


1 


1 




-1 


-2 


-2 


-2 


-1 



104 



d2 



-2 


-2 


-1 




1 


-2 




1 


3 




-1 


1 


4 


1 


-1 




3 


1 




-2 


1 




-1 


-2 


-2 



105 




••dl 



-1 




1 




-1 


-2 


1 


2 


1 


-2 


-2 


1 


4 


1 


-2 


-2 


1 


2 


1 


-2 


-1 




1 




-1 



d4 



106 



1 




-1 


-2 


-2 




3 


1 




-2 


-1 


1 


4 


1 


-1 


-2 




1 


3 




-2 


-2 


-1 




1 



20 



(19) 



J 




(12) 



Europdisches Patentamt 
European Patent Office . 
Office europden des brevets (11) EP 0 737 932 A3 

EUROPEAN PATENT APPLICATION 



(88) Date of publication A3: 

22.01.1997 Bulletin 1997/04 

(43) Date of pubiication A2: 

16.10.1996 Bulletin 1996/42 

(21) Application number: 96105813.8 

(22) Date of filing: 12.04.1996 



(51) IntCI.^: G06K9/00 



(84) 


Designated Contracting States: 


(72) 


Inventor: Kamei, Toshio 




DE FR GB 




MInato-ku, Tokyo (JP) 


(30) 


Priority: 12.04.1995 JP 86754/95 


(74) 


Representative: Betten & Resch 








Reichenbachstrasse 19 


(71) 


Applicant: NEC CORPORATION 




80469 Munchen (DE) 




Tokyo (JP) 







(54) An apparatus for extracting skin pattern features and a skin pattern image processor 



(57) A skin pattern image is filtered by convolution 
calculation on a real plane or product calculation on a 
Fourier transformed plane with each of two-dimensional 
filters prepared according to kinds of features to be 
extracted of the skin pattern image. Image intensity of 
each subregion of each filtered data is calculated. Fea- 
ture of each subregion is represented by a feature 
parameter corresponding to a fitter that gives a highest 
value of the image intensity of the subregion. An initial 
pattern of features thus obtained is smoothed to mini- 
mize an evaluation function. A filtered skin pattern 
image having pixel values of each subregion smoothed 
by a set of filters prepared for extracting a kind of fea- 
tures is further filtered by another set of filters for 
extracting another kind of features. 



FIG. 1 



SKIN PATTERN IMAGE 
11 



IMAGE MEMORY || 



12 



FlLTERiNQ MEANS 



15 



FILTER RLE 





IMAGE INTENSUTY 
CALCULATION MEANS 






1 


FEATURE 
EXTRACTING MEANS 





EXTRACTED FEATURES 



CO 

< 

CM 
CO 

o> 

CO 



0. 

LU 



Printed by Rank Xerox (UK) Business Servioes 
2.13.130.4 



EPO 737 932 A3 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



AppHcadoD Nunbo' 

EP 96 10 5813 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Catcfiory 



Ckalioa of document with indicatioii, where appropriate. 
of retevant passages 



Rcfevant 
to cteim 



CLASSinCATlON OF THE 
APPLICATION datCLb) 



lEE PROC.-VIS. IMAGE SIGNAL PROCESS.* 

vol. 141, no, 2, April 1994, 

pages 87-94, XPeoe6ie431 

B. G. SHERLOCK, D M. MONRO ET K. MILLARD: 

"Fingerprint enhancement by directional 

Fourier filtering" 

Section "1.2 Overview of the enhancement 
algorithm" 

Section "1.4 Algorithm for estimating LRO 
at a point" 

* figure 1 * 

IEEE INT. SYMP. ON COMPUTER VISION, 
21 November 1995, CORAL GABLES, CA. USA. 
pages 109-114, XPO006e9299 
T. KAMEI ET M. MIZOGUSHI: "Image filter 
design for fingerprint enhancement' 

* the whole document * 

EP-A-0 551 086 (NIPPON ELECTRIC CO) 14 
July 1993 

* abstract * 



1-9 



G06K9/00 



1-9 



TECHNICAL FIELDS 
SEARCHED (IiitCL6) 



G06K 



Hie 



report has heca drawn<up for all daiais 



§ 

2 



THE HAGUE 



27 November 1996 



Granger, B 



S 

o 

id 



CATEGORY OF CITED DOCUMENTS 

X : puticulariy rdwint tf taken alooe 

Y : particulariy rdcvuit if combfaicd with another 

document of the sane categoty 
A : technological hacfcgronnd 
O : Qoo-'writtcn disclosure 
P : iBtetnediate document 



T : thcDiy or prindiae nndetiying the tevenllM 
E : earlier patent document, but published on, or 

after the filing date 
D : docamcat dtcd in the application 
L : docamcat dtcd far other rcuoas 



A : member of tlio 
document 



patent family, cacTcspooding 



2 



